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10. A method for 
buffering data in 
an integrated 
circuit having a 
plurality of 
processing 
modules being 
connected with an 
interconnect 
through interface 
units, wherein a 
first processing 
module 
communicates to a 
second processing 
module using 
transactions, the 
method 
comprising the 
acts of: 


Without conceding that the preamble of claim 10 of the “800 Patent is limiting, the OnePlus 10T 
(hereinafter, the “OnePlus product”) performs a method for buffering data in an integrated circuit 
having a plurality of processing modules being connected with an interconnect through interface 
units, wherein a first processing module communicates to a second processing module using 
transactions), either literally or under the doctrine of equivalents. 


The OnePlus product includes an integrated circuit. For example, the OnePlus product includes 
the Snapdragon 8+ Gen 1 Mobile Platform system on chip (hereinafter, the “Snapdragon SoC”). 


OnePlus 10T 


Powered by Snapdragon 8+ Gen 1 Mobile Platform 


OnePlus 10T 5G is the speed-leading flagship delivering 
ultimate performance. Driven relentlessly by the fastest 
charging in OnePlus history and the powerful Snapdragon 8+ 
Gen 1 mobile platform, this is a phone built to evolve beyond 
speed. It has Qualcomm FastConnect 6900 for premium Wi- 


Fi connectivity and a Kryo CPU for unbeatable performance. 


https: //www.qualcomm.com/snapdragon/ device-finder /smartphones /oneplus-10t 


1 The OnePlus product is charted as a representative product made used, sold, offered for sale, and/or imported by OnePlus. The citations to evidence contained herein are illustrative 
and should not be understood to be limiting. The right is expressly reserved to rely upon additional or different evidence, or to rely on additional citations to the evidence cited 


already cited herein. 
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Gen 1 


Artificial Intelligence 
Qualcomm* Adreno” GPU 


Qualcomm* Kryo” CPU 


Qualcomm* Hexagon” Proc 
* Fused Al Accelerator 
Hexagon Tensor Accelerator 


Hexagon Vector eXtensions 


Hexagon Sex ecelerator 
* Support for mix precision( INT8+iINT16) 


* Support for all precisions (INT8, INTI6, FP16) 


Qualcomm" Sensing Hub 


5G Modem-RF System 

Snapdragon* X65 5G Modem-RF System 

* 5G mm\Wave and sub-6 GHz, standalone 

* (SA) and non-standalone (NSA) modes, FDD, TDD 
* Dynamic Spectrum Sharing 

2x2 MIMO 


Sub-6 GHz: 4x4 MIMO 


* mmWave: 8 carriers 


* Qualcomm’ 5G PowerSave 2.0 
* Qualcomm® Smart Transmit” 2.0 technology 
* Qualcomm" Wideband Envelope Tracking 


* Qualcomm* Al-Enhanced Signal Boost 


‘ 


* Global SG multi-SIN 


Downlink: Up to 10 Gbps 


00 Patent Claim OnePlus Product Including Snapdragon System on Chip! 
The Snapdragon SoC comprises a plurality of processing modules, for example Qualcomm 
Adreno GPU; Qualcomm Kryo CPU; Qualcomm Hexagon Processor; and Platform Security 
Foundations, Trusted Execution Environment & Services, Secure Processing Unit (SPU): 


$} Snapdragon 


8+ mobile platform 


Camera 


Qualcomm Spectra™ Image Signal Processor 


Triple 18-bit ISPs 


sigapixels per Second computer vision ISP 


Up to 36 MP triple camera @ 30 FPS with Zero 
Shutter Lag 
Up to 64*36 MP dual camera @ 30 FPS with Zero 


Shutter Lag 


Up to 108 MP single camera @ 30 FPS with Zero 


Shutter Lag 

Up to 200 Megapixel Photo Capture 
Rec. 2020 color gamut photo and video capture 
Up to 10-bit color depth photo and video capture 


8K HDR Video Capture + 64 MP Pho 


10-bit HEI": HEIC photo capture, HEVC video capture 


Sapture Formats: HDORIO+, HDR10, HLG, 


fision 


Video 
Dolby 


8K HDR Video Capture @ 30 FPS 


4K Video Capture @ 120 FPS 


Slow-mo video capture at Pp @ 960 FPS 
Bokeh Engine for Video Capture 

Video super resolution 

Multi-frame Noise Reduction (MFNR) 


Locally Motion Compensated Temporal Filtering 


Multi-Frame and triple exposure staggered/digital 


overlap HDR ducal-sensor support 


face detection, auto: 


SPECIFICATIONS & FEATURES 


CPU 


Kryo CPU 
* Up to 3.2 GHz; with Arm Cortex-X2 technology 


* 64-bit Architecture 


Visual Subsystem 


Adreno GPU 


* Vulkan* 1.1 API support 


* HDR gaming (10-bit color depth, Rec. 2 
color gamut) 

* Physically Based Rendering 

* Volumetric Rendering 


* Adreno Frame Motion Engine 


* API Support: OpenGL* ES 3.2, OpenCL” 2.0 FP, 


Vulkan 1.1 


* Hardware-accelerated H.265 and VP9 decoder 


* HDR Playback Codec support for HDRIO+, HDRIO, 
HLG and Dolby Vision 


Security 


Ptatform Security Foundations, Trusted Execution 
Environment & Services, Secure Processing Unit (SPU) 


Trust Management Engine 


Qualcomm’ wireless edge services (WES) and 


premium security features 


Qualcomm’ 3D Sonic Sensor and Qualcomm’ 3D 
Sonic Max (fingerprint sensor) 


Qualcomm’ Type-! Hypervisor 
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Wi-Fi & Bluetooth’ 


* MIMO Configuration: 2x2 (2-strearm) 


* MU-MIMO (Uplink & Downlink) 
4K QAM 


OFDMA (Uplink & Downlir 


* Bluetooth Features: Bluetooth® 5.3, LE Audio, Duc 
Bluetooth antennas 

* Bluetooth audio: Snapdragon Sound” Technology 
with s . 2, aptx 
Lossless, aptX Adaptive, and LE audio 


ort for Qualcomm’ aptX” Voic 


snapdragon.com 


https://www.qualcomm.com/content/dam 


assets / documents/Snapdragon-8-plus-Gen-1-Product-Brief.pdf 


The Snapdragon SoC included in the OnePlus product utilizes Arteris network on chip 
interconnect technology, and/or a derivative thereof, (collectively, the “Arteris NoC”) as an 
interconnect to connect the plurality of processing modules through interface units: 


Audio 


Qualcomm Aastic” audio codec (Wi 


N 


Ww 


Total Harmonic Distortion + Noise (THD+N), Playback 


108dB 


Qualcomm’ Audio and Voice Communication Suite 


Display 
On-Device Display Support: 
* 4K @ 60 Hz 
IHD+ @ 144 Hz 
Maximum External Display Support 
up to 4K @ 60 Hz 
> 10-bit color depth, Rec. 2020 color gamut 


* HDRIO and HDRIO+ 


Demura and subpixel rendering for OLED Uniformity 


comm-martech/dm- 
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Charging 


Qualcomm” Quick Charge” 5 Technology 


Location 


GPS, Glonass, BeiDou, Galileo, QZSS 
NaviC capable 

Dual Frequency GNSS (L1/L5) 
Sensor-Assisted Positioning 


Jrban pedestrian navigation with 


ICCUFACy 


+ Global freeway lane-level vehicle navigation 


General Specifications 

ull Suite of Snapdragon Elite Gaming” features 
&.nm Pr s Technology 

JSB Version 3.1; USB Type-C Support 


Part Number: SM8475 
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Qualcomm 


QuALCOMW\ 


Arteris-developed NoC technology is the 
backbone of Snapdragon application 
processors & LTE modems, Atheros 
wireless connectivity SoCs, and CSR loT 
products. 


LEARN MORE » 


https: / /web.archive.org/web/20210514110614/https:/ /www.arteris.com/ customers 
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Certain Arteris Technology Assets Acquired 


by Kurt Shuler, on October 31, 2013 


Arteris to continue to license, support and maintain Arteris FlexNoC® interconnect IP 


SUNNYVALE, California — October 31, 2013 — Arteris Inc., a leading innovator and supplier of silicon-proven 
commercial network-on-chip (NoC) interconnect IP solutions, today announced that Qualcomm Technologies, 
Inc. (‘Qualcomm’), a subsidiary of Qualcomm Incorporated, has acquired certain technology assets from Arteris 
and hired personnel formerly employed by Arteris. 


GG Arteris NoC technology has been and will continue to be a key enabler for 
creating larger and more complex chips in a shorter amount of time at a 
lower cost. This acquisition of our technology assets represents a validation 
of the value of Arteris’ Network-on-Chip interconnect IP technology. 


ARTERISia 


K. Charles janac, President and CEO, Arteris 


https://www.arteris.com/ press-releases /Qualcomm-Arteris-asset-acquisition-2013_oct_31; 
https:/ / www ..fiercewireless.com/tech/qualcomm-acquires-arteris-noc-tech-assets-team 


A large SoC, such as the Snapdragon SoC included in the OnePlus product may include multiple 
classes of Arteris NoC interconnect: 
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Logical Interconnect Topology Development 


FLEXNOC & NCORE INTERCONNECT IPS DEFINE ARCHITECTURES 


Ncore Cache Coherent NoC 
fuss ZEECELEE 


F firewall 


PSs 


‘Axoid+ 
n 


Pel ~=—-s Cache Coherent es 
Interconnect 


1 
P) OBS. 


A 
2) i 
Do o1 a 
io} 


fe) TF] 
Memory NoC Sched 
DRAM 


| sRaw DRAM DRAM DRAM 


e ArChip16 Example: Large SoCs have multiple classes of interconnect 
— Non-coherent, Coherent, Control/Status, Observability, etc. 
e Necore & FlexNoC interconnects are managed separately from IP blocks, increasing design flexibility 


ARTER isi ISPD 2018, 28 March 2018 Copyright © 2018 Arteris 1P | 9 
See Physical Interconnect Aware Network Optimizer, http:/ /www.ispd.cc/slides/2018/s7_2.pdf, 
at slide 9. 


The Arteris NoC is an interconnect connects the plurality of processing modules in the 
Snapdragon SoC included in the OnePlus product through interface units, wherein a first 
processing module communicates to a second processing module using transactions. 


For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
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NoC, “[mlJost transactions require the following two-step transfers,” including “[a] master 
send[ing] request packets” and “the slave return[ing] response packets”: 


11.3.1.1 Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shownin Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 


on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313; see id at 308 
(explaining that Chapter 11 of this book describes the function of the Arteris NoC: “In this chapter 
we will present an MPSoC platform [...] using Arteris NoC as communication infrastructure.”). 


configuring the The Arteris NoC utilized by the Snapdragon SoC included in the OnePlus product configures the 
first processing first processing module having a first memory as a master the provides requests, either literally or 
module having a __| under the doctrine of equivalents. 

first memory as a 
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master the For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
provides requests; | third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
NoC, “[mlJost transactions require the following two-step transfers,” including “[a] master 
send[ing] request packets” and “the slave return[ing] response packets”: 


11.3.1.1 Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Initiator NIUs are “used to connect a master node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As a further example, “Initiator NIU units...enable connection between an AMBA-AHB master IP 
and the NoC [and] translate[] AHB transactions AHB transactions into an equivalent NTTP packet 
sequence, and transports requests and responses to and from a target NIU, that is, slave IP” and 
has a “FIFO memory [...] inserted in the datapath for AHB write access”: 
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11.3.2.1 Initiator NIU Units 


Initiator NIU units (the architecture of the AHB initiator is given in Figure 
11.4) enable connection between an AMBA-AHB master IP and the NoC. 
It translates AHB transactions into an equivalent NTTP packet sequence, 
and transports requests and responses to and from a target NIU, that is, 
slave IP (slave can be any of the supported protocols). The AHB-to-NTTP 
unit instantiates a Translation Table for address decoding. This table receives 
32-bit AHB addresses from the NIU and returns the packet header and necker 
information that is needed to access the NTTP address space: Slave address, 
Slave offset, Start offset, and the coherency size (see Figure 11.2). Whenever 
the AHB address does not fit the predefined decoding range, the table as- 
serts an error signal that sets the error bit of the corresponding NTTP request 
packet, for further error handling by the NoC. The translation table is fully 
user-defined at design time: it must first be completed with its own hardware 
parameters, then passed to the NIU. 

A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 
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burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 


15 


4890-2737-3377.3 


Case 2:22-cv-00481-JRG Document 1-43 Filed 12/19/22 Page 16 of 113 PagelD #: 2105 


U.S. Patent No. 8,086,800 (Radulescu and Goossens) 
“Integrated circuit and method for buffering to optimize burst length in networks on chips” 


800 Patent Claim OnePlus Product Including Snapdragon System on Chip 1 
NIU Architecture 


TRANSLATION 


AHB Req pa 


Response Path 


Information from 
FLOW request path 
CONTROL 


AHB Resp 


% 
: 
A 
ES 
= 
72) 
a 
Z 


FIGURE 11.4 

Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


configuring the The Arteris NoC utilized by the Snapdragon SoC included in the OnePlus product configures the 
second processing | second processing module having a second memory as a slave the provides responses to the 
module havinga ___| requests, either literally or under the doctrine of equivalents. 

second memory as 
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a slave the For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
provides third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
responses to the NoC, “[mlJost transactions require the following two-step transfers,” including “[a] master 
requests; send[ing] request packets” and “the slave return[ing] response packets”: 


11.3.1.1 Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Target NIUs are “used to connect a slave node to the NoC”: 


4890-2737-3377.3 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As further example, “Target NIU units enable connection of a slave IP to the NoC by translating 
NTTP packet sequences into equivalent packet transactions, and transporting requests and 
responses to and from targets” and have a FIFO memory in the datapath: 
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11.3.2.2 Target NIU Units 


Target NIU units enable connection of a slave IP to the NoC by translat- 
ing NTTP packet sequences into equivalent packet transactions, and trans- 
porting requests and responses to and from targets (the architecture of the 
AHB Target NIU is given in Figure 11.5). For the AHB target NIU, the AHB 
address space is mapped from the NTTP address space using the slave offset, 
the start/stop offset, and the slave address fields, when applicable (from the 
header of the request packet, Figure 11.2). The AHB address bus is always 


32 bits wide, but the actual address space size may be downsized by setting a 
hardware parameter. Unused AHB address bits are then driven to zero. The 
NTTP request packet is then translated into one or more corresponding AHB 
accesses, depending on the transaction type (word aligned or nonaligned ac- 
cess). For example, if the request is an atomic Store, or a Load that can fit an 
AHB burst of specified length, then such a burst is generated. Otherwise, an 
AHB burst with unspecified length is generated. 
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FIGURE 11.5 
Network interface unit: Target architecture. 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 318-319. 


connecting the 
master to a master 


The Arteris NoC utilized by the Snapdragon SoC included in the OnePlus product connects the 
master to a master interface unit of the interface units, either literally or under the doctrine of 


equivalents. 
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interface unit of 
the interface units; | For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
master and slave nodes: 


11.3.1.1 Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Initiator NIUs are “used to connect a master node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 

¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As a further example, “Initiator NIU units...enable connection between an AMBA-AHB master IP 
and the NoC”: 
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11.3.2.1 Initiator NIU Units 


Initiator NIU units (the architecture of the AHB initiator is given in Figure 
11.4) enable connection between an AMBA-AHB master IP and the NoC. 
It translates AHB transactions into an equivalent NTTP packet sequence, 
and transports requests and responses to and from a target NIU, that is, 
slave IP (slave can be any of the supported protocols). The AHB-to-NTTP 
unit instantiates a Translation Table for address decoding. This table receives 
32-bit AHB addresses from the NIU and returns the packet header and necker 
information that is needed to access the NTTP address space: Slave address, 
Slave offset, Start offset, and the coherency size (see Figure 11.2). Whenever 
the AHB address does not fit the predefined decoding range, the table as- 
serts an error signal that sets the error bit of the corresponding NTTP request 
packet, for further error handling by the NoC. The translation table is fully 
user-defined at design time: it must first be completed with its own hardware 
parameters, then passed to the NIU. 

A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 
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burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


connecting the 
master interface 
unit to the 


The Arteris NoC utilized by the Snapdragon SoC included in the OnePlus product connects the 
master interface unit to the interconnect so that the master interface unit is between the master 
and the interconnect, either literally or under the doctrine of equivalents. 
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interconnect so 


that the master For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
interface unit is third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
between the NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
master and the master and slave nodes, between the nodes and the network: 

interconnect; 


11.3.1.1 Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Initiator NIUs are “used to connect a master node to the NoC”: 


4890-2737-3377.3 


32 


vdoc.pub/download/networks-on-chips- 


Case 2:22-cv-00481-JRG Document 1-43 Filed 12/19/22 Page 33 of 113 PagelD #: 2122 


U.S. Patent No. 8,086,800 (Radulescu and Goossens) 
“Integrated circuit and method for buffering to optimize burst length in networks on chips” 


800 Patent Claim OnePlus Product Including Snapdragon System on Chip 1 


11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 

¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As a further example, “Initiator NIU units...enable connection between an AMBA-AHB master IP 
and the NoC”: 
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11.3.2.1 Initiator NIU Units 


Initiator NIU units (the architecture of the AHB initiator is given in Figure 
11.4) enable connection between an AMBA-AHB master IP and the NoC. 
It translates AHB transactions into an equivalent NTTP packet sequence, 
and transports requests and responses to and from a target NIU, that is, 
slave IP (slave can be any of the supported protocols). The AHB-to-NTTP 
unit instantiates a Translation Table for address decoding. This table receives 
32-bit AHB addresses from the NIU and returns the packet header and necker 
information that is needed to access the NTTP address space: Slave address, 
Slave offset, Start offset, and the coherency size (see Figure 11.2). Whenever 
the AHB address does not fit the predefined decoding range, the table as- 
serts an error signal that sets the error bit of the corresponding NTTP request 
packet, for further error handling by the NoC. The translation table is fully 
user-defined at design time: it must first be completed with its own hardware 
parameters, then passed to the NIU. 

A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 
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burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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FIGURE 11.4 

Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


connecting the The Arteris NoC utilized by the Snapdragon SoC included in the OnePlus product connecting the 
slave to aslave slave to a slave interface unit of the interface units, either literally or under the doctrine of 


equivalents. 
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interface unit of 
the interface units; | For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
master and slave nodes: 


11.3.1.1 Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Target NIUs are “used to connect a slave node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As further example, “Target NIU units enable connection of a slave IP to the NoC by translating 
NTTP packet sequences into equivalent packet transactions, and transporting requests and 
responses to and from targets”: 
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11.3.2.2 Target NIU Units 


Target NIU units enable connection of a slave IP to the NoC by translat- 
ing NTTP packet sequences into equivalent packet transactions, and trans- 
porting requests and responses to and from targets (the architecture of the 
AHB Target NIU is given in Figure 11.5). For the AHB target NIU, the AHB 
address space is mapped from the NTTP address space using the slave offset, 
the start/stop offset, and the slave address fields, when applicable (from the 
header of the request packet, Figure 11.2). The AHB address bus is always 


32 bits wide, but the actual address space size may be downsized by setting a 
hardware parameter. Unused AHB address bits are then driven to zero. The 
NTTP request packet is then translated into one or more corresponding AHB 
accesses, depending on the transaction type (word aligned or nonaligned ac- 
cess). For example, if the request is an atomic Store, or a Load that can fit an 
AHB burst of specified length, then such a burst is generated. Otherwise, an 
AHB burst with unspecified length is generated. 
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FIGURE 11.5 
Network interface unit: Target architecture. 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 318-319. 
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connecting the The Arteris NoC utilized by the Snapdragon SoC included in the OnePlus product connects the 
slave interface unit | slave interface unit to the interconnect so that the slave interface unit is between the slave and the 
to the interconnect | interconnect, either literally or under the doctrine of equivalents. 

so that the slave 


interface unit is For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
between the slave | third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
and the NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
interconnect; master and slave nodes, between the nodes and the network: 


11.3.1.1_ Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shownin Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Target NIUs are “used to connect a slave node to the NoC”: 


4890-2737-3377.3 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As further example, “Target NIU units enable connection of a slave IP to the NoC by translating 
NTTP packet sequences into equivalent packet transactions, and transporting requests and 
responses to and from targets”: 
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11.3.2.2 Target NIU Units 


Target NIU units enable connection of a slave IP to the NoC by translat- 
ing NTTP packet sequences into equivalent packet transactions, and trans- 
porting requests and responses to and from targets (the architecture of the 
AHB Target NIU is given in Figure 11.5). For the AHB target NIU, the AHB 
address space is mapped from the NTTP address space using the slave offset, 
the start/stop offset, and the slave address fields, when applicable (from the 
header of the request packet, Figure 11.2). The AHB address bus is always 


32 bits wide, but the actual address space size may be downsized by setting a 
hardware parameter. Unused AHB address bits are then driven to zero. The 
NTTP request packet is then translated into one or more corresponding AHB 
accesses, depending on the transaction type (word aligned or nonaligned ac- 
cess). For example, if the request is an atomic Store, or a Load that can fit an 
AHB burst of specified length, then such a burst is generated. Otherwise, an 
AHB burst with unspecified length is generated. 
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Network interface unit: Target architecture. 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 318-319. 


determining bya_ | The Arteris NoC utilized by the Snapdragon SoC included in the OnePlus product determines by 


master a master determination unit of the master interface unit a first optimal amount of data to be 
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determination unit | buffered by a master wrapper of the master interface unit, either literally or under the doctrine of 


of the master equivalents. 
interface unit a 
first optimal For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 


amount of datato | third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
be buffered by a NoGC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
master wrapper of | master and slave nodes, between the nodes and the network: 

the master 


ee: 11.3.1.1 Transaction Layer 
interface unit; 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Initiator NIUs are “used to connect a master node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


In the Arteris NoC “Initiator NIU units...enable connection between an AMBA-AHB master IP 
and the NoC” and includes blocks such as “Data FIFO,” “Translation Table,” “Build Header & 
Necker,” and “Packet Assembly”: 
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Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317. 


In the Initiator NIUs of the Arteris NoC, a “FIFO memory is inserted in the datapath for AHB 

write accesses. The FIFO memory absorbs data at the AHB initiator rate, so that NITP packets can 

burst at NoC rate as soon as a minimum amount of data has been received.” “[T]he FIFO depth is 
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defined by the hardware parameter” which “indicates the amount of data required to generate a 
Store packet: each time the FIFO is full, a Request packet is sent on the Tx port”: 


11.3.2.1 Initiator NIU Units 


Initiator NIU units (the architecture of the AHB initiator is given in Figure 
11.4) enable connection between an AMBA-AHB master IP and the NoC. 
It translates AHB transactions into an equivalent NTTP packet sequence, 
and transports requests and responses to and from a target NIU, that is, 
slave IP (slave can be any of the supported protocols). The AHB-to-NTTP 
unit instantiates a Translation Table for address decoding. This table receives 
32-bit AHB addresses from the NIU and returns the packet header and necker 
information that is needed to access the NTTP address space: Slave address, 
Slave offset, Start offset, and the coherency size (see Figure 11.2). Whenever 
the AHB address does not fit the predefined decoding range, the table as- 
serts an error signal that sets the error bit of the corresponding NTTP request 
packet, for further error handling by the NoC. The translation table is fully 
user-defined at design time: it must first be completed with its own hardware 
parameters, then passed to the NIU. 

A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 
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burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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FIGURE 11.4 

Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


The Arteris NoC utilized by the Snapdragon SoC included in the OnePlus product determines by 


determining by a 
a slave determination unit of the slave interface unit a second optimal amount of data to be 


slave 
determination unit 
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of the slave buffered by a slave wrapper of the slave interface unit, either literally or under the doctrine of 
interface unit a equivalents. 

second optimal 
amount of datato | For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
be buffered by a third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
slave wrapper of | NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 

the slave interface | master and slave nodes, between the nodes and the network: 


unit; 11.3.1.1 Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shownin Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Target NIUs are “used to connect a slave node to the NoC”: 


4890-2737-3377.3 


a9 


vdoc.pub/download/networks-on-chips- 


Case 2:22-cv-00481-JRG Document 1-43 Filed 12/19/22 Page 60 of 113 PagelD #: 2149 


U.S. Patent No. 8,086,800 (Radulescu and Goossens) 
“Integrated circuit and method for buffering to optimize burst length in networks on chips” 


800 Patent Claim OnePlus Product Including Snapdragon System on Chip 1 


11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As further example, “Target NIU units enable connection of a slave IP to the NoC by translating 
NTTP packet sequences into equivalent packet transactions, and transporting requests and 
responses to and from targets” and includes blocks such as “Data FIFO “and “Packet Assembly”: 
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11.3.2.2 Target NIU Units 


Target NIU units enable connection of a slave IP to the NoC by translat- 
ing NTTP packet sequences into equivalent packet transactions, and trans- 
porting requests and responses to and from targets (the architecture of the 
AHB Target NIU is given in Figure 11.5). For the AHB target NIU, the AHB 
address space is mapped from the NTTP address space using the slave offset, 
the start/stop offset, and the slave address fields, when applicable (from the 
header of the request packet, Figure 11.2). The AHB address bus is always 


32 bits wide, but the actual address space size may be downsized by setting a 
hardware parameter. Unused AHB address bits are then driven to zero. The 
NTTP request packet is then translated into one or more corresponding AHB 
accesses, depending on the transaction type (word aligned or nonaligned ac- 
cess). For example, if the request is an atomic Store, or a Load that can fit an 
AHB burst of specified length, then such a burst is generated. Otherwise, an 
AHB burst with unspecified length is generated. 
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FIGURE 11.5 
Network interface unit: Target architecture. 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 318-319. 
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In the Target NIUs of the Arteris NoC, similar to as described above for the Initiator NIUs, “[a] 
FIFO memory is inserted in the datapath for AHB ... accesses. The FIFO memory absorbs data at 
the AHB ... rate, so that NITP packets can burst at NoC rate as soon as a minimum amount of 
data has been received.” “[T]he FIFO depth is defined by the hardware parameter” which 
“indicates the amount of data required to generate a ... packet: each time the FIFO is full, a... 
packet is sent on the Tx port”: 


A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 


burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


buffering by the The Arteris NoC utilized by the Snapdragon SoC included in the OnePlus product buffers by the 
slave wrapper of | slave wrapper of the slave interface unit data from the slave to be transferred over the 

the slave interface | interconnect until a first optimal amount of data is buffered, either literally or under the doctrine 
unit data from the | of equivalents. 


slave to be 

transferred over 

the interconnect For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
until a first third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
optimal amount of | NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
data is buffered; master and slave nodes, between the nodes and the network: 


11.3.1.1 Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shownin Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Target NIUs are “used to connect a slave node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As further example, “Target NIU units enable connection of a slave IP to the NoC by translating 
NTTP packet sequences into equivalent packet transactions, and transporting requests and 
responses to and from targets” and includes blocks such as “Data FIFO “and “Packet Assembly”: 
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11.3.2.2 Target NIU Units 


Target NIU units enable connection of a slave IP to the NoC by translat- 
ing NTTP packet sequences into equivalent packet transactions, and trans- 
porting requests and responses to and from targets (the architecture of the 
AHB Target NIU is given in Figure 11.5). For the AHB target NIU, the AHB 
address space is mapped from the NTTP address space using the slave offset, 
the start/stop offset, and the slave address fields, when applicable (from the 
header of the request packet, Figure 11.2). The AHB address bus is always 


32 bits wide, but the actual address space size may be downsized by setting a 
hardware parameter. Unused AHB address bits are then driven to zero. The 
NTTP request packet is then translated into one or more corresponding AHB 
accesses, depending on the transaction type (word aligned or nonaligned ac- 
cess). For example, if the request is an atomic Store, or a Load that can fit an 
AHB burst of specified length, then such a burst is generated. Otherwise, an 
AHB burst with unspecified length is generated. 
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Target NIU Architecture 
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FIGURE 11.5 
Network interface unit: Target architecture. 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 318-319. 


69 


4890-2737-3377.3 


Case 2:22-cv-00481-JRG Document 1-43 Filed 12/19/22 Page 70 of 113 PagelD #: 2159 


U.S. Patent No. 8,086,800 (Radulescu and Goossens) 
“Integrated circuit and method for buffering to optimize burst length in networks on chips” 


800 Patent Claim OnePlus Product Including Snapdragon System on Chip 1 


In the Target NIUs of the Arteris NoC, similar to as described above for the Initiator NIUs, “[a] 
FIFO memoty is inserted in the datapath for AHB ... accesses. The FIFO memory absorbs data at 
the AHB ... rate, so that NITP packets can burst at NoC rate as soon as a minimum amount of 
data has been received.” “[T]he FIFO depth is defined by the hardware parameter” which 
“indicates the amount of data required to generate a ... packet: each time the FIFO is full, a... 
packet is sent on the Tx port”: 


A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 


burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


As a further illustration, the Arteris NoC uses “a mechanism called rated adaptation, which stalls 
packets just enough to remove wait states from the packets, preserving a low latency.” For other 
traffic, the “[b]est effort traffic can be left untouched[,]” “[l]atency sensitive traffic may have its 
urgency modulated as a function of the transaction[,]” “[s]oft real-time traffic may have its hurry 
level modulated as a function of the bandwidth it receives|,]” and “[o]n the real-time modem data 
port, the hurry is fixed at a critical level”: 


Those effects can be mended by the insertion of buffering. In the case of peak bandwidth 
reduction, a simple FIFO does the job: Busy states present at the output of the FIFO do 
not propagate back to the input until the FIFO is full. For a peak bandwidth increase, the 
situation is a bit more complex. In a FIFO, wait states present at the input are only absorbed 
when the FIFO is not empty. Arteris proposes a mechanism called rate adaptation, which 
stalls packets just enough to remove wait states from the packets, preserving a low latency. 

In this second step, the architecture is modified to introduce some buffering. In our ex- 
ample 760 bytes of memory have been distributed across the topology. Some have been put 
on existing links; some required the creation of new links. 


See Application driven network-on-chip architecture exploration & refinement for a complex SoC, 
https://www.arteris.com/hs-fs/hub/48858 /file-14363521- 


pdf/docs/springerappdrivennocarchitecture8.5x11.pdf, at pg.16. 


transferring the The Arteris NoC utilized by the Snapdragon SoC included in the OnePlus product transfers the 
buffered data from | buffered data from the slave wrapper to the master wrapper when said first optimal amount of 
the slave wrapper | data has been buffered by the slave wrapper, either literally or under the doctrine of equivalents. 
to the master 
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wrapper when For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
said first optimal | third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
amount of data NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 

has been buffered | master and slave nodes, between the nodes and the network: 

by the slave 


11.3.1.1 Transaction Layer 
wrapper; 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Target NIUs are “used to connect a slave node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As further example, “Target NIU units enable connection of a slave IP to the NoC by translating 
NTTP packet sequences into equivalent packet transactions, and transporting requests and 
responses to and from targets” and includes blocks such as “Data FIFO ”and “Packet Assembly”: 
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11.3.2.2 Target NIU Units 


Target NIU units enable connection of a slave IP to the NoC by translat- 
ing NTTP packet sequences into equivalent packet transactions, and trans- 
porting requests and responses to and from targets (the architecture of the 
AHB Target NIU is given in Figure 11.5). For the AHB target NIU, the AHB 
address space is mapped from the NTTP address space using the slave offset, 
the start/stop offset, and the slave address fields, when applicable (from the 
header of the request packet, Figure 11.2). The AHB address bus is always 


32 bits wide, but the actual address space size may be downsized by setting a 
hardware parameter. Unused AHB address bits are then driven to zero. The 
NTTP request packet is then translated into one or more corresponding AHB 
accesses, depending on the transaction type (word aligned or nonaligned ac- 
cess). For example, if the request is an atomic Store, or a Load that can fit an 
AHB burst of specified length, then such a burst is generated. Otherwise, an 
AHB burst with unspecified length is generated. 
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Target NIU Architecture 
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FIGURE 11.5 
Network interface unit: Target architecture. 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 318-319. 
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In the Target NIUs of the Arteris NoC, similar to as described above for the Initiator NIUs, “[a] 
FIFO memorty is inserted in the datapath for AHB ... accesses. The FIFO memory absorbs data at 
the AHB ... rate, so that NITP packets can burst at NoC rate as soon as a minimum amount of 
data has been received.” “[T]he FIFO depth is defined by the hardware parameter” which 
“indicates the amount of data required to generate a ... packet: each time the FIFO is full, a... 
packet is sent on the Tx port”: 


A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 


burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


buffering by the The Arteris NoC utilized by the Snapdragon SoC included in the OnePlus product buffers by the 
master wrapper of | master wrapper of the master interface unit data from the master to be transferred over the 

the master interconnect until a second optimal amount of data is buffered by the master wrapper, either 
interface unit data | literally or under the doctrine of equivalents. 

from the master to 
be transferred over | For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
the interconnect third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
until a second NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
optimal amount of | master and slave nodes, between the nodes and the network: 

data is buffered by 
the master 
wrapper; The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


11.3.1.1 Transaction Layer 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shownin Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Initiator NIUs are “used to connect a master node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


In the Arteris NoC “Initiator NIU units...enable connection between an AMBA-AHB master IP 
and the NoC” and includes blocks such as “Data FIFO,” “Translation Table,” “Build Header & 
Necker,” and “Packet Assembly”: 
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FIGURE 11.4 

Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317. 


In the Initiator NIUs of the Arteris NoC, a “FIFO memory is inserted in the datapath for AHB 

write accesses. The FIFO memory absorbs data at the AHB initiator rate, so that NITTP packets can 

burst at NoC rate as soon as a minimum amount of data has been received.” “[T]he FIFO depth is 
83 


4890-2737-3377.3 


Case 2:22-cv-00481-JRG Document 1-43 Filed 12/19/22 Page 84 of 113 PagelD #: 2173 


U.S. Patent No. 8,086,800 (Radulescu and Goossens) 
“Integrated circuit and method for buffering to optimize burst length in networks on chips” 


800 Patent Claim OnePlus Product Including Snapdragon System on Chip 1 


defined by the hardware parameter” which “indicates the amount of data required to generate a 
Store packet: each time the FIFO is full, a Request packet is sent on the Tx port”: 


11.3.2.1 Initiator NIU Units 


Initiator NIU units (the architecture of the AHB initiator is given in Figure 
11.4) enable connection between an AMBA-AHB master IP and the NoC. 
It translates AHB transactions into an equivalent NTTP packet sequence, 
and transports requests and responses to and from a target NIU, that is, 
slave IP (slave can be any of the supported protocols). The AHB-to-NTTP 
unit instantiates a Translation Table for address decoding. This table receives 
32-bit AHB addresses from the NIU and returns the packet header and necker 
information that is needed to access the NTTP address space: Slave address, 
Slave offset, Start offset, and the coherency size (see Figure 11.2). Whenever 
the AHB address does not fit the predefined decoding range, the table as- 
serts an error signal that sets the error bit of the corresponding NTTP request 
packet, for further error handling by the NoC. The translation table is fully 
user-defined at design time: it must first be completed with its own hardware 
parameters, then passed to the NIU. 

A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 
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burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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FIGURE 11.4 

Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


As a further illustration, the Arteris NoC uses “a mechanism called rated adaptation, which stalls 
packets just enough to remove wait states from the packets, preserving a low latency.” For other 
traffic, the “[b]est effort traffic can be left untouched][,]” “[l]atency sensitive traffic may have its 
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urgency modulated as a function of the transaction[,]” “[s]oft real-time traffic may have its hurry 
level modulated as a function of the bandwidth it receives|,]” and “[o]n the real-time modem data 
port, the hurry is fixed at a critical level”: 


Those effects can be mended by the insertion of buffering. In the case of peak bandwidth 
reduction, a simple FIFO does the job: Busy states present at the output of the FIFO do 
not propagate back to the input until the FIFO is full. For a peak bandwidth increase, the 
situation is a bit more complex. In a FIFO, wait states present at the input are only absorbed 
when the FIFO is not empty. Arteris proposes a mechanism called rate adaptation, which 
stalls packets just enough to remove wait states from the packets, preserving a low latency. 

In this second step, the architecture is modified to introduce some buffering. In our ex- 
ample 760 bytes of memory have been distributed across the topology. Some have been put 
on existing links; some required the creation of new links. 


See Application driven network-on-chip architecture exploration & refinement for a complex SoC, 
https://www.arteris.com/hs-fs/hub/48858 /file-14363521- 
pdf/docs/springerappdrivennocarchitecture8.5x11.pdf, at pg.16. 

transferring the The Arteris NoC utilized by the Snapdragon SoC included in the OnePlus product transfers the 
buffered data from | buffered data from the master wrapper to the slave wrapper when said second optimal amount of 


the master data has been buffered by the master wrapper, either literally or under the doctrine of equivalents. 
wrapper to the 
slave wrapper For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 


when said second | third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
optimal amount of | NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
data has been master and slave nodes, between the nodes and the network: 

buffered by the 
master wrapper, 
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11.3.1.1 Transaction Layer 

The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 


on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Initiator NIUs are “used to connect a master node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


In the Arteris NoC “Initiator NIU units...enable connection between an AMBA-AHB master IP 
and the NoC” and includes blocks such as “Data FIFO,” “Translation Table,” “Build Header & 
Necker,” and “Packet Assembly”: 
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FIGURE 11.4 

Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317. 


In the Initiator NIUs of the Arteris NoC, a “FIFO memory is inserted in the datapath for AHB 

write accesses. The FIFO memory absorbs data at the AHB initiator rate, so that NITTP packets can 

burst at NoC rate as soon as a minimum amount of data has been received.” “[T]he FIFO depth is 
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defined by the hardware parameter” which “indicates the amount of data required to generate a 
Store packet: each time the FIFO is full, a Request packet is sent on the Tx port”: 


11.3.2.1 Initiator NIU Units 


Initiator NIU units (the architecture of the AHB initiator is given in Figure 
11.4) enable connection between an AMBA-AHB master IP and the NoC. 
It translates AHB transactions into an equivalent NTTP packet sequence, 
and transports requests and responses to and from a target NIU, that is, 
slave IP (slave can be any of the supported protocols). The AHB-to-NTTP 
unit instantiates a Translation Table for address decoding. This table receives 
32-bit AHB addresses from the NIU and returns the packet header and necker 
information that is needed to access the NTTP address space: Slave address, 
Slave offset, Start offset, and the coherency size (see Figure 11.2). Whenever 
the AHB address does not fit the predefined decoding range, the table as- 
serts an error signal that sets the error bit of the corresponding NTTP request 
packet, for further error handling by the NoC. The translation table is fully 
user-defined at design time: it must first be completed with its own hardware 
parameters, then passed to the NIU. 

A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 
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burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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FIGURE 11.4 

Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


wherein at least In the Arteris NoC utilized by the Snapdragon SoC included in the OnePlus product, at least one 
one of the first of the first determination unit and the second determination unit is further configured to 
determination unit | determine an optimal moment for sending the data in said first wrapper or said second wrapper 
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and the second 
determination unit 
is further 
configured to 
determine an 
optimal moment 
for sending the 
data in said first 
wrapper or said 
second wrapper 
according to 
communication 
properties of the 
communication 
between the 
master and the 
slave, wherein the 
communication 
properties include 
ordering of data 
transport, flow 
control including 
when a remote 
buffer is reserved 
for a connection, 
then a data 
producer will be 
allowed to send 
data only when it 


according to communication properties of the communication between the master and the slave 
wherein the communication properties include ordering of data transport, flow control including 
when a remote buffer is reserved for a connection, then a data producer will be allowed to send 
data only when it is guaranteed that space is available for the produced data at the remote buffer, 
throughput where a lower bound on throughput is guaranteed, latency where an upper bound for 
latency is guaranteed, lossiness including dropping of data, transmission termination, transaction 
completion, data correctness, priority, and data delivery, either literally or under the doctrine of 
equivalents. 


For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
NoGC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
master and slave nodes, between the nodes and the network: 


ee AS 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


Transaction Layer 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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Baal on their receive ports, Rx, translate requests so that they comply with the pro- 


i ilabl ; 
A es oe ‘" tocol used by the target third-party IP node. When the target node responds, 


aaa atthe vemos returning responses are again converted by the slave NIU into appropriate 
buffer, throughput response packets, then delivered through the slave NIU’s Tx port to the 
where a lower response network. The network then routes the response packets to the re- 
bound on — questing master NIU, which forwards them to the initiator. At the transaction 
moe es level, NIUs enable multiple protocols to coexist within the same NoC. From 


teed, ‘ ‘ : ; 
ae a on the point of view of the NTTP modules, different third-party protocols are 


upper bound for just packets moving back and forth across the network. 
latency is 
guaranteed, 
lossiness including 
dropping of data, 
transmission 
termination, 
transaction 
completion, data 
correctness, 
priority, and data 
delivery. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Initiator NIUs are “used to connect a master node to the NoC” and the Target NIUs are “used 
to connect a slave node to the NoC”: 


o7 


4890-2737-3377.3 


Case 2:22-cv-00481-JRG Document 1-43 Filed 12/19/22 Page 98 of 113 PagelD #: 2187 


U.S. Patent No. 8,086,800 (Radulescu and Goossens) 
“Integrated circuit and method for buffering to optimize burst length in networks on chips” 


800 Patent Claim OnePlus Product Including Snapdragon System on Chip 1 


11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


In the Arteris NoC “Initiator NIU units...enable connection between an AMBA-AHB master IP 
and the NoC” and includes blocks such as “Data FIFO,” “Translation Table,” “Build Header & 
Necker,” and “Packet Assembly”: 


98 


4890-2737-3377.3 


Case 2:22-cv-00481-JRG Document 1-43 Filed 12/19/22 Page 99 of 113 PagelD #: 2188 


U.S. Patent No. 8,086,800 (Radulescu and Goossens) 
“Integrated circuit and method for buffering to optimize burst length in networks on chips” 


800 Patent Claim OnePlus Product Including Snapdragon System on Chip! 
NIU Architecture 


AHB Req 


AHB Resp 


% 
: 
A 
ES 
= 
72) 
a 
Z 


FIGURE 11.4 

Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317. 


In the Initiator NIUs of the Arteris NoC, a “FIFO memory is inserted in the datapath for AHB 

write accesses. The FIFO memory absorbs data at the AHB initiator rate, so that NITTP packets can 

burst at NoC rate as soon as a minimum amount of data has been received.” “[T]he FIFO depth is 
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defined by the hardware parameter” which “indicates the amount of data required to generate a 
Store packet: each time the FIFO is full, a Request packet is sent on the Tx port”: 


11.3.2.1 Initiator NIU Units 


Initiator NIU units (the architecture of the AHB initiator is given in Figure 
11.4) enable connection between an AMBA-AHB master IP and the NoC. 
It translates AHB transactions into an equivalent NTTP packet sequence, 
and transports requests and responses to and from a target NIU, that is, 
slave IP (slave can be any of the supported protocols). The AHB-to-NTTP 
unit instantiates a Translation Table for address decoding. This table receives 
32-bit AHB addresses from the NIU and returns the packet header and necker 
information that is needed to access the NTTP address space: Slave address, 
Slave offset, Start offset, and the coherency size (see Figure 11.2). Whenever 
the AHB address does not fit the predefined decoding range, the table as- 
serts an error signal that sets the error bit of the corresponding NTTP request 
packet, for further error handling by the NoC. The translation table is fully 
user-defined at design time: it must first be completed with its own hardware 
parameters, then passed to the NIU. 

A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 


100 


4890-2737-3377.3 


Case 2:22-cv-00481-JRG Document 1-43 Filed 12/19/22 Page 101 of 113 PagelD #: 2190 


U.S. Patent No. 8,086,800 (Radulescu and Goossens) 
“Integrated circuit and method for buffering to optimize burst length in networks on chips” 


800 Patent Claim OnePlus Product Including Snapdragon System on Chip 1 


burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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FIGURE 11.4 

Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


As further example, “Target NIU units enable connection of a slave IP to the NoC by translating 
NTTP packet sequences into equivalent packet transactions, and transporting requests and 
responses to and from targets” and includes blocks such as “Data FIFO “and “Packet Assembly”: 
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11.3.2.2 Target NIU Units 


Target NIU units enable connection of a slave IP to the NoC by translat- 
ing NTTP packet sequences into equivalent packet transactions, and trans- 
porting requests and responses to and from targets (the architecture of the 
AHB Target NIU is given in Figure 11.5). For the AHB target NIU, the AHB 
address space is mapped from the NTTP address space using the slave offset, 
the start/stop offset, and the slave address fields, when applicable (from the 
header of the request packet, Figure 11.2). The AHB address bus is always 


32 bits wide, but the actual address space size may be downsized by setting a 
hardware parameter. Unused AHB address bits are then driven to zero. The 
NTTP request packet is then translated into one or more corresponding AHB 
accesses, depending on the transaction type (word aligned or nonaligned ac- 
cess). For example, if the request is an atomic Store, or a Load that can fit an 
AHB burst of specified length, then such a burst is generated. Otherwise, an 
AHB burst with unspecified length is generated. 
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FIGURE 11.5 
Network interface unit: Target architecture. 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 318-319. 
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In the Target NIUs of the Arteris NoC, similar to as described above for the Initiator NIUs, “[a] 
FIFO memoty is inserted in the datapath for AHB ... accesses. The FIFO memory absorbs data at 
the AHB ... rate, so that NITP packets can burst at NoC rate as soon as a minimum amount of 
data has been received.” “[T]he FIFO depth is defined by the hardware parameter” which 
“indicates the amount of data required to generate a ... packet: each time the FIFO is full, a... 
packet is sent on the Tx port”: 


A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 


burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


As a further illustration, the “Arteris NTTP protocol is packet-based” and the packets, which have 
“header and necker cells [that] contain information relative to routing, payload size, packet type, 
and the packet target address,” are “transported to other parts of the NoC to accomplish the 
transactions that are required by foreign IP nodes”: 


11.3.1.2 Transport Layer 


The Arteris NTTP protocol is packet-based. Packets created by NIUs are trans- 
ported to other parts of the NoC to accomplish the transactions that are 
required by foreign IP nodes. All packets are comprised of cells: a header 
cell, an optional necker cell, and possibly one or more data cells (for packet 
definition see Figure 11.2; further descriptions of the packet can be found in 
the next subsection). The header and necker cells contain information relative 
to routing, payload size, packet type, and the packet target address. Formats 
for request packets and response packets are slightly different, with the key 
difference being the presence of an additional cell, the necker, in the request 
packet to provide detailed addressing information to the target. 


Id. at 313. 


As yet a further illustration, packets in the Arteris NoC are “delivered as words that are sent 
along links and “[o]ne link (represented in Figure 11.1) defines the following signals,” which 
include “the current priority of the packet used to define preferred traffic class (or Quality of 
Service)” and “[f]low control”: 
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¢ Data—Data word of the width specified at design-time. 

¢ Frm—When asserted high, indicates that a packet is being transmit- 
ted. 

e Head—When asserted high, indicates the current word contains a 
packet header. When the link-width is smaller than single (SGL), the 
header transmission is split into several word transfers. However, 
the Head signal is asserted during the first transfer only. 

e TailOfs—Packet tail: when asserted high, indicates that the current 
word contains the last packet cell. When the link-width is smaller 
than single (SGL), the last cell transmission is split into several word 
transfers. However, the Tail signal is asserted during the first transfer 
only. 

e Pres.—Indicates the current priority of the packet used to define 
preferred traffic class (or Quality of Service). The width is fixed 


during the design time, allowing multiple pressure levels within 
the same NoC instance (bits 3-5 in| Figure 11.2). 
¢ Vld—Data valid: when asserted high, indicates that a word is being 


transmitted. 


¢ RxRdy—Flow control: when asserted high, the receiver is ready to 
accept word. When de-asserted, the receiver is busy. 


Id. at 313-314. 
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As a further illustration, the Arteris NoC implements Quality of Service (QoS) to “provide[] a 
regulation mechanism allowing specification of guarantees on some of the parameters related to 
the traffic”; “QoS, which includes guarantees of throughput and/or latency, is achieved by 
exploiting the signal pressure embedded into the NTTP packet definition” where the “pressure 
signal can be generated by the IP itself and is typically linked to a certain level of urgency with 
which the transaction will have to be completed”; and the “pressure information will be 
embedded in the NTTP packet at the NIU level”: 


Quality of Service (QoS). The QoS is a very important feature in the inter- 
connect infrastructures because it provides a regulation mechanism allowing 
specification of guarantees on some of the parameters related to the traf- 
fic. Usually the end users are looking for guarantees on bandwidth and/or 
end-to-end communication latency. Different mechanisms and strategies have 
been proposed in the literature. For instance, in Aithereal NoC [11,24] pro- 
posed by NXP, a TDMA approach allows the specification of two traffic cat- 
egories [25]: BE and GT. 

In the Arteris NoC, the QoS is achieved by exploiting the signal pressure em- 
bedded into the NTTP packet definition (Figures 11.1 and 11.2). The pressure 
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signal can be generated by the IP itself and is typically linked to a certain level 
of urgency with which the transaction will have to be completed. For exam- 
ple, we can imagine associating the generation of the pressure signal when a 
certain threshold has been reached in the FIFO of the corresponding IP. This 
pressure information will be embedded in the NTTP packet at the NIU level: 
packets that have pressure bits equal to zero will be considered without QoS; 
packets with a nonzero value of the pressure bit will indicate preferred traffic 
class.* Such a QoS mechanism offers immediate service to the most urgent 
inputs and variables, and fair service whenever there are multiple contend- 
ing inputs of equal urgency (BE). Within switches, arbitration decisions favor 
preferred packets and allocate remaining bandwidth (after preferred packets 
are served) fairly to contending packets. When there are contending preferred 
packets at the same pressure level, arbitration decisions among them are also 
fair. 
The Arteris NoC supports the following four different traffic classes: 
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e Real time and low latency (RTLL)—TIraffic flows that require the 
lowest possible latency. Sometimes it is acceptable to have brief 
intervals of longer latency as long as the average latency is low. 
Care must be taken to avoid starving other traffic flows as a side 
effect of pursuing low latency. 


¢ Guaranteed throughput (GT)—Traffic flows that must maintain 
their throughput over a relatively long time interval. The actual 
bandwidth needed can be highly variable even over long intervals. 
Dynamic pressure is employed for this traffic class. 


e Guaranteed bandwidth (GBW)—Iraffic flows that require a guar- 
anteed amount of bandwidth over a relatively long time interval. 
Over short periods, the network may lag or lead in providing this 
bandwidth. Bandwidth meters may be inserted onto links in the 
NoC to regulate these flows, using either of the two methods. If the 
flow is assigned high pressure, the meter asserts backpressure (flow 
control) to prevent the flow from exceeding a maximum bandwidth. 
Alternatively, the meter can modulate the flows pressure (priority) 
dynamically as needed to maintain an average bandwidth. 


e Best effort (BE)—TIraffic flows that do not require guaranteed 
latency or throughput but have an expectation of fairness. 
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* Note that in the NTTP packet, the pressure field allows more then one bit, resulting in multiple 
levels of preferred traffic. 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 315-316. 


In addition, the Arteris Interconnect includes “a mechanism called rated adaptation, which stalls packets just 
enough to remove wait states from the packets, preserving a low latency.” For other traffic, the “[b]est effort 
traffic can be left untouched[,]|” “[I]atency sensitive traffic may have its urgency modulated as a function of 
the transaction[,]” “[s]oft real-time traffic may have its hurry level modulated as a function of the bandwidth 
it receives[,]” and “[o]n the real-time modem data port, the hurry is fixed at a critical level.” 


Those effects can be mended by the insertion of buffering. In the case of peak bandwidth 
reduction, a simple FIFO does the job: Busy states present at the output of the FIFO do 
not propagate back to the input until the FIFO is full. For a peak bandwidth increase, the 
situation is a bit more complex. In a FIFO, wait states present at the input are only absorbed 
when the FIFO is not empty. Arteris proposes a mechanism called rate adaptation, which 
stalls packets just enough to remove wait states from the packets, preserving a low latency. 

In this second step, the architecture is modified to introduce some buffering. In our ex- 
ample 760 bytes of memory have been distributed across the topology. Some have been put 
on existing links; some required the creation of new links. 


Application driven network-on-chip architecture exploration & refinement for a complex SoC, 
https://www.arteris.com/hs-fs/hub/48858/file-14363521-pdf/docs/springer- 


appdrivennocarchitecture8.5x11.pdf, at p. 16. 
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For the other traffic, the configuration can be done in architecture. 


e Best effort traffic can be left untouched. 

e Latency sensitive traffic may have its urgency modulated as a function of the transaction: 
Normal for writes and important for reads. 

e Soft real-time traffic may have its hurry level modulated as a function of the bandwidth 
it receives: Critical until a specified bandwidth is obtained on a sliding 4 microsecond 
window, and normal thereafter. These settings are set through configuration registers and 
may be modified while the interconnect is running. The mechanism is called a bandwidth 
regulator. 

e On the real-time modem data port, the hurry is fixed at a critical level. 


Id. at 18. 


As a further illustration, the Arteris NoC implements QoS mechanisms that performs arbitration 
based on “Bandwidth Regulartor (BR)” and “Bandwidth Limiter (BL)”: 
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Bandwidth Limiters and Rate Regulators 


Many times architects will want to implement QoS within their SoC but the QoS 
prioritization data is not available from the individual IP blocks. In this case, QoS 
information may be generated from within the NoC interconnect using Arteris’ QoS 
Generator. The QoS Generator can instantiate sophisticated, and software 
programmable, means to regulate interconnect QoS, including: 


> Bandwidth Limiters - Bandwidth limiters cause a socket to stop accepting 
requests when a run-time programmable throughput threshold has been 
exceeded. 

> Rate Regulators - Rate regulators cause a socket's transactions to be demoted 
when a bandwidth threshold is reached. This can be considered a smoother 
version of the bandwidth limiter because transactions are only demoted 
instead of stalled. 


https://www.arteris.com/end-to-end-quality-of-service-qos 
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